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Background of the Invention 

Field of the Invention 

The present invention relates generally to delivering interrupt requests to 
10 microprocessors. More particularly, the present invention relates to delivering interrupt 
requests to a multiple processors in a system utilizing multi-node architecture. 

Description of the Related Art 

In a conventional computer system, an input device, such as a keyboard, a disk 
drive, a joystick, or a mouse generates an interrupt request when it is used. An interrupt 
15 request functions to stop or interrupt a microprocessor from the program it was executing 
and force the processor to pay attention to and service the input device. For example, if a 
user presses a key on a keyboard, the keyboard generates an interrupt request to interrupt 
the processor from the program it was executing. The processor will service the input 
from the keyboard before resuming the original program it was executing. 

20 Depending on the purpose of the key press, the processor may detect what key 

was hit and display it on the screen. In another case, the processor may detect what key 
was hit to issue a command to the computer, such as a command in a video game or a 
command in the operating system. Clearly, during the normal operation of a computer, it 
is possible for an input device to generate a large number of interrupt requests. Further, 

25 each computer system may include multiple input devices. Therefore, to optimize system 
performance, it is important to deliver each of the interrupt requests to the correct 
processor in an efficient manner. 

Figure 1 illustrates a conventional interrupt delivery system 10 for a single-node 
computer system. Interrupt delivery system 10 includes a scalable node controller (SNC) 
30 12, which is coupled to an input/output hub (IOH) 14 and a number of processors 16a-d. 
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IOH 14 is coupled to a number of peripheral component interconnect (PCI) devices 18a- 
b. The design of interrupt delivery system 10 (such as the 460 GX system produced by 
Intel Corporation) was a major improvement over previous generations because it allows 
interrupt requests to be delivered virtually from PCI devices 18a-b to processors 16a-d. 
5 In a previous generation (such as the 450 NX system produced by Intel), an interrupt 
request generated by PCI devices would be delivered to processors through side wires 
(sometimes referred to as APIC sideband bus). 

When a PCI device 18a or 18b requires servicing, it performs a write command to 
a special address. The write is received by IOH 14 and transmitted on the data bus to 

10 SNC 12. After receiving the write, SNC 12 recognizes the special address to be written 
to and converts the write command to an interrupt request. Each interrupt request 
includes an ID, which identifies the processor 16a, 16b, 16c 5 or 16d that should be 
interrupted by the request. If the specific processor is not too busy (i.e., executing a 
program with a higher priority), the processor is interrupted and services PCI device 18a 

15 or 18b before resuming the execution of the previous program. If the specific processor 
is too busy, SNC 12 may transmit the interrupt request to the processor when it has 
finished the more important task or if SNC 12 has the proper information, it may redirect 
the interrupt request to a different processor. 

Recent developments in computer technology have allowed for the design and 
20 manufacture of computer systems implementing a multi-node architecture (i.e., multiple 
SNCs). Each additional node is able to support an additional set of processors that may 
operate simultaneously with all of the other processors, resulting in a tremendous 
increase in computing power. Furthermore, the additional nodes also provide the system 
with greater flexibility (in the event that a node fails) and additional memory. The end 
25 result is a multi-node computer system that offers a great deal more reliability, 
accessibility, and service (RAS) than a single-node system. 

While interrupt delivery system 10 is adequate to support delivery of interrupt 
requests to a single node along a single, straight pathway, it does not provide any 
mechanism to deliver requests to multiple nodes along more complicated pathways. If, 
30 for example, an additional SNC were coupled to IOH 14, interrupt delivery system 10 
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would be unable to identify which SNC should receive an interrupt request. Therefore, it 
would be impossible route the interrupt request to the correct processor. 

In addition, not being able to facilitate the simple delivery of interrupt requests 
from PCI devices to processors, interrupt delivery system 10 also does not provide 
5 mechanisms for redirecting interrupt requests to a processor located on a different node 
or for sending an interrupt request from a processor to another processor located on a 
different node. Therefore, it is desirable to have a method and apparatus for routing and 
delivering interrupt requests along the pathways of a multi-node system. 
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Brief Description of the Drawings 



The present invention will be readily understood by the following detailed 
description in conjunction with the accompanying drawings. To facilitate this 
description like reference numerals designate like structural elements. 

5 Figure 1 illustrates a conventional interrupt delivery system in a single-node 

computer system. 

Figure 2 illustrates an interrupt delivery system for a multi-node computer system 
in accordance with one embodiment of the present invention. 

Figure 3 illustrates an interrupt delivery system for a multi-node computer system 
10 in accordance with a preferred embodiment of the present invention. 

Figure 4 illustrates mechanisms of the interrupt delivery system for delivering 
interrupts in an IA32 system. 

Figure 5 is a flow chart of a method for delivering IRQs in a multi-node computer 
system in accordance with one embodiment of the present invention. 
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Detailed Description 



A method and apparatus for routing and delivering interrupt requests in a multi- 
node system is provided. In the following description, numerous specific details are set 
forth in order to provide a thorough understanding of the present invention. It will be 
5 understood, however, to one skilled in the art, that the present invention may be practiced 
without some or all of these specific details. In other instances, well known process 
operations have not been described in detail in order not to unnecessarily obscure the 
present invention. 

Figure 2 illustrates an interrupt delivery system 20 for a multi-node computer 
system in accordance with one embodiment of the present invention. Interrupt delivery 
system 20 includes a first SNC 22, which is coupled to processors 24a-d, and a second 
SNC 26, which is coupled to processors 28a-d. Both SNCs 22 and 26 are coupled to a 
SPS 30, which is in turn coupled to an IOH 32. IOH 32 is also coupled to a PCI 64-bit 
hub (P64H) 34, which supports a number of PCI devices 36a-d. 

If, for example, PCI device 36a requires servicing, it generates an interrupt 
request (IRQ), which is transmitted to P64H 34 through a side wire 37. After receiving 
the IRQ, an interrupt controller inside P64H 34 converts the IRQ into a write command 
and an ID 38 containing the destination information of the IRQ. ID 38 preferably 
includes a node address 40 and a processor address 42. The data is then transmitted to 
SPS 30 through IOH 32 (which will be detailed below) as a write command having an 
attribute equal to an interrupt and ID 38. 

Based on the node ID, SPS 30 will transmit the write command and its attribute to 
the correct SNC. The SPS accomplishes this task because it contains registers that stores 
the ID of the SNCs. Assuming that SNC 22 is identified by node address 40, SNC 22 
25 will read processor address 42 to determine the correct destination processor. SNC 22 
then analyzes a register 44 with priority information about each processor 24a-d 
indicating whether or not it may be interrupted. Register 44 is located within SNC 22 
itself and collects status reports from processors 24a-d. Assuming that processor 24a 
may be interrupted and is identified by processor address 42, SNC 22 will translate the 
30 write and attribute to a processor bus interrupt request that is sent to processor 24a. 
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Processor 24a will then temporarily interrupt the program it is running to service PCI 
device 36a. 

If processor 24a is too busy to accept the IRQ, SNC 22 may decide to either wait 
until the task with the higher priority is completed before sending the IRQ, or SNC 22 

5 may choose to redirect the IRQ to another processor. (Note, the Intel 870 Chipset always 
redirects to the least busy processor instead of waiting.) To support the redirection 
process, ID 38 may include an indicator bit, which indicates whether the IRQ may be 
redirected. If the indicator bit confirms that IRQ may be redirected, then SNC 22 may 
redirect the IRQ to SNC 26, which performs the same analyses of the IRQ to determine 

10 which processor 28a-d may be interrupted. 

Figure 3 illustrates an interrupt delivery system 46 for a multi-node computer 
system in accordance with a preferred embodiment of the present invention. The 
operation of interrupt delivery system 46 is similar to interrupt delivery system 20, 
described in Figure 2. However, interrupt delivery system 46 is optimized to support two 
15 additional SNCs 48 and 50, for a total of four SNCs, each of which supports a set of 
processors. The end result is a multi-node system having a great deal of processing 
power (such as in the Intel 870 Chipset). 

Each SNC 22, 26, 48, and 50 is coupled to SPSs 30 and 52. While an additional 
SPS is not necessary for interrupt delivery system 46 to operate, it provides for twice as 

20 much throughput and maximum bandwidth. The additional SPS also provides a backup, 
in case one SPS is disabled. SPSs 30 and 52 are then coupled to IOHs 32 and 54. The 
main purpose of using an IOH in interrupt delivery system 46 is for expandability. Each 
IOH is able to support numerous PCI hubs, including an interconnect hub (ICH2) 56 and 
P64Hs 34 and 58 as illustrated in Figure 3. ICH2 56 is a type of PCI hub that is 

25 configured to support a keyboard 60. Each of the PCI devices shown in Figure 3, 
including keyboard 60 represent a newer type of PCI device which is able to generate a 
write command, thereby eliminating the need for side wire connections to a PCI hub. 

Each embodiment of the present invention may also be easily modified to 
include mechanisms to facilitate IRQ delivery in different multi-node systems. One such 
30 example of modified IRQ delivery is IRQ delivery to microprocessors from legacy 
devices such as an 8259 controller. With such devices, once the processor has received 
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the IRQ, an interrupt acknowledge must be sent back to the interrupt controller to 
confirm receipt of the IRQ. Another example of a system for which the present invention 
may be modified is the IA32 system. 

Figure 4 illustrates mechanisms of interrupt delivery system 20 for delivering 
5 interrupts in an IA32 system (an example of which would be the Pentium 4 family). 
Because the identification scheme in IA32 systems is less efficient than in IA64 systems, 
the IA32 has two additional interrupt delivery requirements. First, after each level 
triggered interrupt delivery, SPS 30 (actually the whole chipset) is required to issue an 
end of interrupt (EOI) to communicate to the interrupt controller embedded in the P64H2 
10 or ICH2 that the processor is finished servicing a particular PCI device. 

Since the EOI message from the processor does not contain information as to 
which interrupt controller the interrupt came from, the chipset must devise a way to 
deliver the EOI to the correct interrupt controller. (Only the interrupt vector is available.) 
This is done by the SNC sending the EOI message to the SPS. The SPS broadcasts the 
15 EOI to all IOH components. Finally, the IOH broadcasts the EOI to all P64H2s and 
ICH2s. The interrupt controller that recognizes the interrupt vector will act on the EOI. 
Remaining controllers will ignore it. 

Second, an IA32 system also needs to sometimes send a broadcast interrupt. A 
broadcast interrupt occurs when a processor (i.e., processor 24a) or I/O device sends an 

20 IRQ to all other processors in the system. For example, the broadcast IRQ is received by 
SNC 22 from the processor, which issues a write command with an interrupt attribute to 
SPS 30. SPS 30 is able to recognize the origin of the command and forward it to all of 
the other SNCs in the system, in this case SNC 26. One example of a broadcast interrupt 
is when a laptop computer powers back up from standby mode. In this example, the user 

25 hits the proper function buttons and a processor (or device) issues a broadcast interrupt to 
all other processors in the system to restart the system. In each case (legacy, EOI, and 
broadcast IRQs), the flexibility of the interrupt delivery systems of the present invention 
allows for painless adaptation to the interrupt delivery needs of other systems. 

Figure 5 is a flow chart of a method 62 for delivering IRQs in a multi-node 
30 computer system in accordance with one embodiment of the present invention. Method 
62 begins at a block 64 where an interrupt request is received by a scalability port switch. 
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The IRQ may be generated by either an input device or a processor. The input device is 
preferably a PCI device that can generate an in band IRQ (in the form of a write and 
attribute command) to the SPS through a PCI hub and an IOH. After receiving the 
request, the SPS determines a scaleable node controller to receive the interrupt request in 
5 a block 66. The write and attribute also includes an ID having a node address identifying 
the proper SNC for the SPS to transmit to. 

Once the correct SNC has been identified, method 62 proceeds to a block 66 
where the interrupt write and attribute is transmitted to the proper SNC. Upon receiving 
the IRQ, the SNC determines which processor to interrupt in a block 68. The identity of 

10 the processor may be determined from the processor address in the ID. Once the correct 
processor has been identified, the SNC preferably compares the priority of the IRQ with 
the priority of the current processor task. If the processor is too busy to interrupt, the 
SNC may decide to delay interrupting the processor until it is less busy, or to redirect the 
IRQ to a different processor on a different node through the SPS. Otherwise, in a block 

15 70, the SNC translates the write and attribute commands to an IRQ that can be 
understood by the processor and then transmits the IRQ to the processor in a block 72. 

Other embodiments of the invention will be apparent to those skilled in the art 
from consideration of the specification and practice of the invention. Furthermore, 
certain terminology has been used for the purposes of descriptive clarity, and not to limit 
20 the present invention. The embodiments and preferred features described above should 
be considered exemplary, with the invention being defined by the appended claims. 
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